Validation of the conceptual research utilization scale: an application of the standards for educational and psychological testing in healthcare

<p>Abstract</p> <p>Background</p> <p>There is a lack of acceptable, reliable, and valid survey instruments to measure conceptual research utilization (CRU). In this study, we investigated the psychometric properties of a newly developed scale (the CRU Scale).</p> <p>Methods</p> <p>We used the <it>Standards for Educational and Psychological Testing </it>as a validation framework to assess four sources of validity evidence: content, response processes, internal structure, and relations to other variables. A panel of nine international research utilization experts performed a formal content validity assessment. To determine response process validity, we conducted a series of one-on-one scale administration sessions with 10 healthcare aides. Internal structure and relations to other variables validity was examined using CRU Scale response data from a sample of 707 healthcare aides working in 30 urban Canadian nursing homes. Principal components analysis and confirmatory factor analyses were conducted to determine internal structure. Relations to other variables were examined using: (1) bivariate correlations; (2) change in mean values of CRU with increasing levels of other kinds of research utilization; and (3) multivariate linear regression.</p> <p>Results</p> <p>Content validity index scores for the five items ranged from 0.55 to 1.00. The principal components analysis predicted a 5-item 1-factor model. This was inconsistent with the findings from the confirmatory factor analysis, which showed best fit for a 4-item 1-factor model. Bivariate associations between CRU and other kinds of research utilization were statistically significant (p < 0.01) for the latent CRU scale score and all five CRU items. The CRU scale score was also shown to be significant predictor of overall research utilization in multivariate linear regression.</p> <p>Conclusions</p> <p>The CRU scale showed acceptable initial psychometric properties with respect to responses from healthcare aides in nursing homes. Based on our validity, reliability, and acceptability analyses, we recommend using a reduced (four-item) version of the CRU scale to yield sound assessments of CRU by healthcare aides. Refinement to the wording of one item is also needed. Planned future research will include: latent scale scoring, identification of variables that predict and are outcomes to conceptual research use, and longitudinal work to determine CRU Scale sensitivity to change.</p

The benefits of using reduced item variable scales in marketing segmentation

This article was published in the Journal of Marketing Communications [© Taylor & Francis (Routledge)] and the definitive version is available at: http://dx.doi.org/10.1080/13527266.2012.723026This study investigated the use of two reduced item constructs in marketing research, Involvement Scale and Consumer Expertise and their relationships. Previous findings suggested that both constructs could use reduced items and that they would be useful as marketing segmentation tools. Response rates to consumer questionnaires are declining; therefore, shorter questionnaires in marketing communications are more likely to be completed. This study establishes the current reliability of using these two reduced item constructs in automotive research and tests their validity using triangulation questions. Data collection used a novel approach in which respondents to a motor show used the new Apple iPad to complete an online questionnaire. Results revealed that the reduced item constructs are reliable and valid and would be useful for research involving large ticket items. They would be particularly useful to researchers where they are used as part of, rather than the main focus of, the research